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Remarks 

1. This communication is responsive to the amendment filed July 18 th , 2006. 
Claims 1-19 are pending. In the amendment filed July 18 th , 2006, Claims 1,4-6, 10, 18, 
19 are amended, and Claims 1,18, and 19 are independent. The examiner 
acknowledges that no new matter was introduced and the claims are supported by the 
specification. This action is FINAL. 

Response to Arguments 

2. The Applicant's arguments filed July 18 th , 2006 with respect to Claims 1-19 have 
been considered but are not persuasive. 

3. As to the applicant's arguments with respect to Claims 1,18, and 19 for the prior 
art(s) allegedly not disclosing or suggesting "a retrieval condition setting area arranged 
in a matrix form in which each row and column are respectively assigned to one 
independent retrieval condition," the examiner respectfully disagrees. This new 
limitation has been mapped below to the Barber reference in each of the claims. 
Barber, in the cited sections below, teach a query window where the user drags & drops 
retrieval conditions to query for images having conditions described by the layout of the 
conditions in the window. The layout of the conditions in the window is a matrix as 
shown in the associating figure, Fig. 5. . . 
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4. The other claims argued merely because of a dependency on a previously 
argued claim(s) in the arguments presented to the examiner, filed July 18 th , 2006, are 
moot in view of the examiner's interpretation of the claims and art and are still 
considered rejected based on their respective rejections from the first Office action 
(parts of recited again below). 

Response to Amendment 
Information Disclosure Statement 

5. The information disclosure statement is being considered by the examiner. 

Specification 

6. The lengthy specification has not been checked to the extent necessary to 
determine the presence of all possible minor errors. Applicant's cooperation is 
requested in correcting any errors of which applicant may become aware in the 
specification. The published version of the application published "32'" as "321." Text 
searching the document for "32'" therefore, did not return any hits. 

Drawings 

7. In light of the applicant's respective arguments or respective amendments, the 
previous drawing objections to the drawings have been withdrawn. When considering 
Applicant's arguments, it was discovered that the previous drawing objection was based 
on a publication error in the published version of this application. 
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Claim Objections 

8. In light of the applicant's respective arguments or respective amendments, some 
previous claim objections to the claims have been withdrawn. However, new objections 
below are warranted by the amendments. 

9. Claims 1, 12, 18, and 19 are objected to because of the following informalities: 

a. Claim 12 recites a parenthetical phrase in lines 3-4. It is unclear if this is 
claimed subject matter. 

b. Claim 1 recites "and" in line 5. This is prior to the second to last limitation 
in the claim, which is not grammatically correct. The location of "and" in the 
amended claim implies that the last limitation is not included in the method of 
Claim 1. Claims 18 and 19 recite this similar error. 

c. Claim 18 recites "an input unit configured to one of set multimedia object 
data" and "multimedia object data one of set in and input to the" in line 7 and line 
12, respectfully. This phraseology makes poor sentence structure in the claims. 
Claim 19 recites similar phraseology. 

Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

10. The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
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(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

11. Claims 1-6, 9, 10, 13-15, and 17 are rejected under 35 U.S.C. 102(b) as being 
anticipated by U.S. Patent No. 5,751 ,286 (Barber et al.). 

Claim 1 can be mapped to Barber as follows: "A method for setting a retrieval 
condition [Barber, col. 7, lines 7-19] when retrieving similar multimedia object data from 
a multimedia object database [Barber, col. 7, lines 7-10] on the basis of the retrieval 
condition set by a user, [Barber, col. 7, lines 7-19] the method comprising: 

• displaying a retrieval condition setting area for setting a plurality of retrieval 
conditions as an independent area; [Barber, col. 5, lines 4-18] and 

• setting a retrieval condition on the basis of one of multimedia object data which 
has been set in the retrieval condition setting area and multimedia object data 
which has been input to the retrieval condition setting area; [Barber, col. 5, lines 
4-18 with Barber, col. 7, lines 7-19] 

• wherein the retrieval condition setting area is arranged in a matrix form in which 
each row and each column are respectively assigned to one independent 
retrieval condition" [Barber, col. 5, lines 4-18 with Barber, col. 8, lines 59-67 with 
Barber, col. 9, lines 35-40 with Barber, Fig. 5]. 

Claim 2 can be mapped to Barber as follows: "The method according to claim 1 , 
wherein the multimedia object data which has been set in the retrieval condition setting 
area comprises one of: inquiry object data which has been set as a retrieval condition; 
and one of an image and item associated with inquiry object data" [Barber, col. 5, lines 
4-18 with Barber, col. 7, lines 7-19 with Barber, Fig. 5]. 
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Claim 3 can be mapped to Barber as follows: "The method according to claim 1 , 
further comprising: 

• displaying an object data list display area for displaying images associated with 
respective data in the multimedia object database, [Barber, col. 5, lines 4-18 with 
Barber, col. 7, lines 7-19 with Barber, Fig. 5] wherein 

• by selecting at least one multimedia object data from the object data list display 
area, the selected multimedia object data is displayed in the retrieval condition 
setting area and a retrieval condition is set" [Barber, col. 5, lines 4-18 with 
Barber, col. 7, lines 7-19 with Barber, Fig. 5]. 

Claim 4 can be mapped to Barber as follows: "The method according to claim 3, 
wherein in response to operation of a control button for setting object data into the 
retrieval condition setting area, disposed near one of an image and item associated with 
multimedia object data in the object data list display area, the multimedia object data is 
displayed in the retrieval condition setting area and a retrieval condition is set" [Barber, 
cols. 8-9, lines 65-4 with Barber, col. 1 1 , lines 45-55 with Barber, col. 1 0, 35-38]. 

Claim 5 can be mapped to Barber as follows: "The method according to claim 3, 
wherein in response to direct specification of one of an image and item associated with 
multimedia object data in the object data list display area, the multimedia object data is 
displayed in the retrieval condition setting area and a retrieval condition is set" [Barber, 
col. 5, lines 4-18 with Barber, col. 7, lines 7-19 with Barber, Fig. 5 with Barber, col. 10, 
35-38]. 
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Claim 6 can be mapped to Barber as follows: "The method according to claim 3, 
wherein in response to operation of a pointing device to specify one of an image and 
item associated with multimedia object data in the object data list display area and 
move it onto the retrieval condition setting area, the multimedia object data is displayed 
in the retrieval condition setting area and a retrieval condition is set" [Barber, col. 5, 
lines 4-18 with Barber, col. 7, lines 7-19 with Barber, Fig. 5 with Barber, col. 4, lines 55- 
59]. 

Claim 9 can be mapped to Barber as follows: "The method according to claim 1 , 
wherein 

• the retrieval condition is set according to a plurality of feature values calculated 
from a multimedia object, [Barber, col. 7, lines 32-43 with Barber, col. 16, lines 
14-18] 

• the retrieval condition setting area has a plurality of feature setting areas, 
[Barber, col. 7, lines 7-20 with Barber, col. 7, lines 32-35] and 

• the feature setting areas are assigned feature kinds which are set according to 
one of: the feature values; and a combination of the feature values" [Barber, col. 
7, lines 7-20 with Barber, cols. 10-11, lines 65-21], 

Claim 10 can be mapped to Barber as follows: "The method according to claim 
9, wherein the feature setting areas are arranged and displayed in an n by m matrix 
form in the retrieval condition setting area, where n and m are natural numbers" [Barber, 
col. 7, lines 13-20]. 



Application/Control Number: 10/695,170 Page 8 

Art Unit: 2161 

Claim 13 can be mapped to Barber as follows: "The method according to claim 
9, wherein 

• the retrieval condition is set according to a combination of feature values which 
have been set in respective feature setting areas provided in the retrieval 
condition setting area, [Barber, col. 7, lines 13-20 with Barber, cols. 10-11, lines 
65-21 with Barber, col. 9, lines 20-25] and 

• a method of the combination is set by the user" [Barber, col. 7, lines 13-20]. 
Claim 14 can be mapped to Barber as follows: "The method according to claim 

9, wherein 

• inquiry object data is set and disposed in an arbitrary position in the retrieval 
condition setting area, [Barber, col. 9, lines 25-35] and 

• a weight of set feature values is set according to a position in which the inquiry 
object data is set and disposed" [Barber, col. 9, lines 35-61]. 

Claim 15 can be mapped to Barber as follows: "The method according to claim 
1 , wherein at the time of retrieval condition setting, attribute information owned by a 
multimedia object is set as a keyword in combination" [Barber, col. 6, lines 17-22 with 
Barber, col. 6, lines 30-35 with Barber, col. 6, lines 50-56]. 

Claim 17 can be mapped to Barber as follows: "The method according to claim 
1, wherein the retrieval condition setting area is displayed in a display screen of a 
display device which is independent in hardware from an apparatus for executing actual 
retrieval" [Barber, col. 4, lines 47-64 with Barber, Figs. 1 and 5]. 
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Claim Rejections - 35 USC § 103 

12. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

13. This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

14. Claims 7, 8, 18, and 19 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent No. 5,751,286 (Barber et al.) in view of U.S. Patent No. 
5,930,783 (Li et al.). 

For Claim 7, Barber teaches: "The method according to claim 2, wherein the 
inquiry object data is set in the retrieval condition setting area by one of." 
Barber discloses the above limitation but does not expressly teach: 
• "inputting it via an external object data input unit connected to a retrieval 
apparatus to which the method according to claim 2 is applied; 
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• selecting it from an external database; and 

• taking in an object data file owned by the user." 

With respect to Claim 7, an analogous art, Li, teaches: 

• Inputting it via an external object data input unit connected to a retrieval 
apparatus to which the method according to claim 2 is applied; 

• selecting it from an external database; and 

• taking in an object data file owned by the user." [Li, col. 1 1 , lines 55-62 with Li, 
col. 17, lines 30-39 with Li, Fig. 12]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Li with Barber because both inventions are directed towards 
searching for multimedia objects based on a query. 

Li's invention would have been expected to successfully work well with Barber's 
invention because both inventions use computers, queries and at least a database. 
Barber discloses an image query system and method comprising finding similar images 
to an inputted query image, however Barber does not expressly disclose using 
thumbnails other than the ones provided. Li discloses semantic and cognition based 
image retrieval comprising the use of external files as base query images. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to take the use of external files as base query images from Li and install it into 
the invention of Barber, thereby offering the obvious advantage of being able to query 
based on any image as an input thumbnail. 
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For Claim 8, Barber (as modified by Li) fails to teach that an Internet address is a 
file path. Official Notice is taken that it is old and well known in the Internet art to get the 
advantage of accessing files on the internet by using Internet addresses as a file path. 
It would have been obvious to one of ordinary skill in the art at the time of the invention 
to include Internet addresses as file paths to get this advantage. 

For Claim 18, Barber teaches: "An apparatus for setting a retrieval condition 
[Barber, col. 7, lines 7-19] when retrieving similar multimedia object data from various 
multimedia object [Barber, col. 7, lines 7-10] on the basis of the retrieval condition set by 
a user, [Barber, col. 7, lines 7-19] the apparatus comprising: 

• a display device having a display screen in which a retrieval condition setting 
area for setting a plurality of retrieval conditions is displayed as an independent 
area; [Barber, col. 5, lines 4-18] 

• an input unit configured to one of set multimedia object data in the retrieval 
condition setting area displayed on the display screen of the display device and 
input multimedia object data to the retrieval condition setting area displayed on 
the display screen of the display device; [Barber, col. 4, lines 55-60 with Barber, 
col. 5, lines 3-18] and 

• a retrieval condition setting unit configured to set a retrieval condition on the 
basis of multimedia object data one of set in and input to the retrieval condition 
setting area by the input unit; [Barber, col. 5, lines 4-18 with Barber, col. 7, lines 
7-19] 
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• wherein the retrieval condition area is arranged in a matrix form in which each 
row and each column are respectively assigned to one independent retrieval 
condition" [Barber, col. 5, lines 4-18 with Barber, col. 8, lines 59-67 with Barber, 
col. 9, lines 35-40 with Barber, Fig. 5]. 

Barber discloses the above limitations but does not expressly teach: "databases." 

With respect to Claim 18, an analogous art, Li, teaches: "databases" [Li, col. 4, 
lines 64-67 with Li, col. 13, lines 37-41]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Li with Barber because both inventions are directed towards 
searching for multimedia objects based on a query. 

Li's invention would have been expected to successfully work well with Barber's 
invention because both inventions use computers, queries and at least a database. 
Barber discloses an image query system and method comprising finding similar images 
to an inputted query image, however Barber does not expressly disclose databases of 
multimedia objects. Li discloses semantic and cognition based image retrieval 
comprising searching databases of multimedia objects. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to take the databases of multimedia objects from Li and install it into the 
invention of Barber, thereby offering the obvious advantage of being able to pull/query 
multiple databases so as to acquire more information that satisfies the query. 

Claim 19 encompasses substantially the same scope of the invention as that of 
Claim 18, in addition to an apparatus and some means for performing the apparatus 
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unit actions of Claim 18. Therefore, Claim 19 is rejected for the same reasons as stated 
above with respect to Claim 1 8. 

15. Claims 11 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over U.S. Patent No. 5,751,286 (Barber et al.) in view of U.S. Patent No. 6,748,398 
(Zhang et al.). 

For Claim 11, Barber teaches: "The method according to claim 1, wherein the 
retrieval condition setting area comprises." 

Barber discloses the above limitation but does not expressly teach: "a dissimilar 
feature setting area for setting a dissimilarity condition independently for each of 
selected objects." 

With respect to Claim 1 1, an analogous art, Zhang, teaches: "a dissimilar feature 
setting area for setting a dissimilarity condition independently for each of selected 
objects" [Zhang, col. 7, lines 27-36]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Zhang with Barber because both inventions are directed towards 
searching for multimedia objects based on a query. 

Zhang's invention would have been expected to successfully work well with 
Barber's invention because both inventions use computers, queries and at least a 
database. Barber discloses an image query system and method comprising finding 
similar images to an inputted query image, however Barber does not expressly disclose 
denoting thumbnails as related or not related to an image being queried. Zhang 
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discloses a relevance maximizing, iteration minimizing, relevance-feedback, content- 
based image retrieval (CBIR) comprising marking images as related or not related to an 
image the user is searching for. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to take the marking images as related or not related from Zhang and install it 
into the thumbnails (which are images) of Barber, thereby offering the obvious 
advantage of narrowing the search for relevant images. 

Claim 12 can be mapped to Barber (as modified by Zhang) as follows: "The 
method according to claim 1 1 , wherein 

• for each of feature values, similar and dissimilar feature setting areas are 
provided as an adjacent pair, [Zhang, col. 7, lines 27-36] and 

• a plurality of pairs are arranged in an n by m (where n and m are natural 
numbers) matrix form" [Barber, col. 7, lines 13-20]. 

16. Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. 
Patent No. 5,751,286 (Barber et al.) in view of U.S. Patent No. 6,363,376 (Wiens et al.). 
For Claim 16, Barber teaches: "The method according to claim 1, wherein 

• a result of retrieval conducted by using the retrieval condition which has been set 
is displayed in a list form in a retrieval result list display area, on the basis of one 
of: an order of similarity; and an order of a result of rearrangement when the user 
has conducted a rearrangement operation on the retrieval result, [Barber, col. 7, 
lines 47-56 with Barber, col. 8, lines 45-55] and 
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• a retrieval condition is set by one of: displaying as many high-ranking multimedia 
object data as a preset number on the basis of an order of display; and selecting 
at least one multimedia object data from the retrieval result list display area and 
displaying the at least one multimedia object data in the retrieval condition setting 
area" [Barber, col. 8, lines 45-55]. 

Barber discloses the above limitations but does not expressly teach: 

• "in the retrieval condition setting area." 

With respect to Claim 16, an analogous art, Wiens, teaches: 

• "in the retrieval condition setting area" [Wiens, col. 7, lines 25-36]. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Wiens with Barber because both inventions are directed towards 
searching for information and returning a certain number of results. 

Wiens's invention would have been expected to successfully work well with 
Barber's invention because both inventions use computers for searching. Barber 
discloses an image query system and method comprising searching for images and 
displaying a pre-specified number of results in a results listing, however Barber does not 
expressly disclose that this pre-specified number is set in the retrieval condition setting 
area by a user. Wiens discloses a method and system for querying and posting to 
multiple career websites on the internet from a single interface comprising the user 
setting the number of results returned from a search in an area that must be equivalent 
to the retrieval condition setting area. 
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It would have been obvious to one of ordinary skill in the art at the time of 
invention to take the user setting the number of results returned from a search from 
Wiens and install it into the invention of Barber, thereby offering the obvious advantage 
of having a more user-friendly user interface that, also, saves computations by limiting 
the number of results returned. 

17. THIS ACTION IS MADE FINAL Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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Conclusion 



18. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Brent S. Stace whose telephone number is 571-272- 
8372 and fax number is 571-273-8372. The examiner can normally be reached on M-F 
9am-5:30pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey A. Gaffin can be reached on 571-272-4146. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Brent Stace 




